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Abstract. The book of Lajos Takacs Combinatorial Methods in the The- 
ory of Stochastic Processes has been published in 1967. It discusses various 
problems associated with 

(*) Pk,i = P < sup (jV„ - n) < k - i \ , 

[i< n < P (i) J 

where N n = v\ + 1/2 . . . + u n is a sum of mutually independent, nonnegative 
integer and identically distributed random variables, nj = P{Vfc = j}, j > 0, 
7ro > 0, and p(i) is the smallest n such that N n = n — i, i > 1. (If there is no 
such n, then p(i) = 00.) 

(*) is a discrete generalization of the classic ruin probability, and its value 
is represented as P k ^ = Qk-i/Qk> where the sequence {Qk}k>0 satisfies the 
recurrence relation of convolution type: Qo ^ and Qj, = X]j=o n jQk— j+l- 

Since 1967 there have been many papers related to applications of the 
generalized classic ruin probability. The present survey concerns only with 
one of the areas of application associated with asymptotic behavior of 
as k — > 00. The theorem on asymptotic behavior of Qk as k — * 00 and 
further properties of that limiting sequence are given on pages 22-23 of the 
aforementioned book by Takacs. In the present survey we discuss applications 
of Takacs' asymptotic theorem and other related results in queueing theory, 
telecommunication systems and dams. Many of the results presented in this 
survey have appeared recently, and some of them are new. In addition, further 
applications of Takacs' theorem are discussed. 
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1. Introduction 

The book of Takacs [75] has been published in 1967. It discusses various problems 
associated with 

(1.1) Pk,i=?\ sup (N n -n) <k-i\ , 

[l<n<p(i) J 

where N n = v\ + . . . + u n is a sum of mutually independent, nonnegative integer 
and identically distributed random variables, 7Tj = P{ffc = j}, j > 0, ttq > 0, and 
p(i) is the smallest n such that N n = n — i, i > 1. (If there is no such n, then 
p(i) = oo.) 

(II. ip is a discrete generalization of classic ruin probability, and its value is repre- 
sented as Pk.i = ^q~' , where the sequence {Qfc}fc>o satisfies the recurrence relation 
of convolution type: 

k 

(1-2) Qk = y]wjQk-j+i, 

3=0 

with arbitrary Qo ^ (see Theorem 2 [7S] on page 18). The probability generating 
function of Q n is 



(1.3) Q( z ) = J2q 



k _ QoAz) 



k=o y ' 

where w(z) = YlT=o 1T kZ k . 

There is also a continuous generalization of the classical ruin theorem in [75] . 

Different applications of the aforementioned recurrence relation have been pro- 
vided for random walks, Brownian motion, queueing processes, dam and storage 
processes, risk processes and order statistics in [75]. Most of these applications in 
[75] and following papers [75] - [51] are associated with an explicit application of a 
generalization of the ruin probability formula or its continuous analogue. 

The ruin problems and ballot theorems have a long history and attract wide 
attention in the literature. The solution of the first problems related to this subject 
had been given in 1887 due to Bertrand [23] (see Sheinin [69] for the review of 
Bertrand's work). For other papers related to ballots problems, their generalizations 
and applications see gB], g7J, gS], [5J], [S5], [57], [55], [5J, [55J, [57J and many 
others. 
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The present survey is concerned with some special application of recurrence 
relation (II. 2)1 . where there is no explicit application of the generalized gambler ruin 
problem. In our application it does not matter what the meaning of values Wj is, 
and what then the fraction A~* means. 

In this survey we discuss applications of asymptotic Theorem 5 of Takacs [75] 
formulated on page 22 and the further asymptotic results on page 23 associated 
with this theorem. We also use the other asymptotic results (Tauberian theorems 
of Postnikov which will be mentioned later). These asymptotic results develop 
the aforementioned asymptotic theorem of Takacs |75j and are used in the paper 
together with Takacs' theorem to accomplish it. Nevertheless, the title of this paper 
is supported by the fact that Takacs' theorem serves as a tool to establish the main 
asymptotic properties of processes, while Postnikov's Tauberian theorems improve 
and strengthen the results on that asymptotic behavior, when additional conditions 
are satisfied. In some delicate cases, applications of Postnikov's Tauberian theorems 
have especial significance, when the case of Takacs' theorem cannot help to establish 
a required property. 

For our convenience, we use the variant of Theorem 5 of [75j in combination with 
formula (35) on page 23 as follows. Denote 

oo I 

j=i k=i 

The value 7^ characterizes the ^th factorial moment related to the probabilities TXj , 
3 > 0. 



lim Q k = ^° . 

k^oo 1 — 71 



Theorem 1.1. Let 7To > 0. Ifji < 1, then 
(1.4) 

If Ji = 1 and 72 < 00, then 
(1.5) 

If 7i > 1; then 



,. Qk 
lim — — 

fc^oo k 



2Q 

72 



(1.6) 



lim 

k — *oo 



Qo 



cr fc (l - tt'(ct)) 



Oo 



1 



7i 



where a is the least nonnegative root of the equation z = tt(z), and < a < 1. 

In the case 72 = 00, [75j recommends to use the Tauberian theorem of Hardy 
and Littlewood [44], [43], which states that if 

1 , / 1 



Q(z) 



-L 



(l-z) a+1 ' \l-z / 

as z t 1, where a > and L(x) is a slowly varying function at infinity (i.e. L(cx) 
L(x) for any positive casi^ 00), then 

k a 



Qk 



■Mk), 



r(a+l)' 

as k — > 00, where T(x) is the Euler gamma- function. 

The case 71 = 1 and 72 < 00 has been developed by Postnikov [65], Sect. 25. 
He established the following two Tauberian theorems. 
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Theorem 1.2. Let ttq > 0. Suppose that 71 = 1 and 73 < 00. Then, as k — ► 00, 

(1.7) Q fc = — n + 0(logn). 

72 

Theorem 1.3. Let 7To > 0. Suppose that 71 = 1, 72 < 00 and 7To + 7Ti < 1. Then, 
as k —> 00, 

(1.8) Q fc+ i -Q fc = — +o(l). 

72 

The applications reviewed in this survey are related to queueing theory, telecom- 
munication systems and dams/storage systems. 

The first paper in this area has been published in 1981 by the author [3J. The 
asymptotic behavior of the mean busy period of the M/G/l queueing system with 
service depending on queue-length has been studied there. This and the several 
later papers have been summarized in book [5]. Other research papers, associated 
with application of (| 1 . 2|) have appeared recently [7], [9] - [13]. In this survey 
we also discuss many other closely related papers, the results of which have been 
obtained by many authors. Several new results related to the asymptotic behavior 
of consecutive losses in M/GI/l/n queueing systems are also established (Sect. 
[3]), and they then applied for analysis of consecutive losses in telecommunication 
systems (Sect. [8]). 

The survey is organized as follows. In Sect. 2-6, which are the first part of 
this survey, we discuss the classical loss queueing systems such as M/GI/l/n, 
GI/M/l/n and GI/M/m/n. For these systems we discuss applications of Takacs' 
theorem 11.11 and Postnikov's theorems 11.21 and 11.31 for analysis of the limiting sta- 
tionary loss probabilities. Sect. [3] contains new results on consecutive losses. In 
Sect. 6 we discuss further research problems related to asymptotic analysis of large 
retrial queueing systems. 

In Sect. 7-12, which, respectively, are the second part of this paper, we discuss 
various applications of these theorems for different models of telecommunication 
systems and dams/storage systems. All of these applications of Takacs' theorem 
are not traditional, and, being specific, the models considered here describe real- 
world systems or models for these systems. The results of Sect. [5] are new. They 
are based on applications of new results on consecutive losses, presented in Sect. 
[5] In Sect. [TT]we discuss further research problems and the ways of their solution 
associated with asymptotic analysis and optimal control of large dams presented in 
Sect. Hand [10] 



Part 1. Applications to queueing systems 

2. Losses in the M/GI/l/n queueing system 

Considering M/GI/l/n queue, Tomko [85] was the first person to establish re- 
currence relation (|1.2|) for the expected busy periods. (We assume that n is the 
number of waiting places excluding the service space.) Let T n denote a busy period, 
and let Tk, k = 0, 1, . . . , n — 1, be busy periods associated with similar queueing 
systems (i.e. having the same rate A of Poisson input and the same probability 
distribution function B(x) of a service time) but only having different number of 
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waiting places. Namely Tomko [88] has derived 
(2.1) ET„ = E(T„_ i+ i) [°° e- Xxi -^dB(x). 



3=0 



In the case of deterministic service times, Tomko [88] used Karamata's Tauberian 
theorem [89], Chapt. 5. 

Representation (|2.ip has been also obtained by Cohen 32j, Cooper and Tilt [55] , 
Rosenlund [57] as well as by the author in [3J and [5]. 

The relationship between the mean busy period in the M/GI/l/n queueing sys- 
tem and the maximum queue-length distribution in the M/GI/l queueing system 
has been established by Cooper and Tilt [33]. Namely, they derived Takacs' result 
[78j on the supremum queue- length distribution of the M/G/l queue during a busy 
period by the methods distinguished from the original Takacs' method. 

With the aid of Theorems 11.11 11.21 and 11.31 one can easily study the asymptotic 
behavior of ET„ as n — > oo. Immediately from these theorems we correspondingly 
have as follows. 

Theorem 2.1. If p < 1, then 

lim ET„ 



n— >oo A(l — p) 

If p = 1 and pi = A 2 J °° x 2 dB(x) < oo, then 

,. ET„ 2 
lim = - — . 

n— too n \p2 

If p > 1, then 
(2.2) lim \ ET n 



n—>OG 



A[l + XB'(X - \ip)]cp n J A(l - p) ' 



where B(s) = J °° e sx dB(x) is the Laplace- Stieltjes transform of a service time, 
and if is the least positive root of the equation 

(2.3) z = B(X-Xz). 

Theorem 2.2. If p = \ and x 3 dB(x) < oo, then as n — > oo 

ET„ = A n + 0(logn). 

Xp2 

Theorem 2.3. If p = 1 and pi < oo, then 

ET„-ET„_ a = JL +0 (1). 

Xp2 

The proof of Theorems 12.11 and 12.21 follows immediately from the statements of 
Theorems 11.11 and 11.21 correspondingly. Let us prove Theorem [ 



Proof. To prove this theorem, it is enough to show that for all A > 
(2.4) B(X) — XB'(X) < 1. 



Then all of the conditions of Theorem 11.31 will be satisfied, and the statement of 
this theorem will follow immediately from Theorem 11.31 
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Let us prove (|2.4I) . Taking into account that 
and 

r e - Xx{ ^dB{x) >0 
Jo j! 

we have 

5(A) - XB'(X) < 1. 
Therefore (|2.4|) will be proved if we show that for some Ao the equality 

(2.5) B(X ) - X B'(X ) = 1 

is not the case. Indeed, since B(X) — XB'(X) is an analytic function in A, then, ac- 
cording to the theorem on maximum absolute value of an analytic function, equality 
(|2~51) is to valid for all A > 0, i.e. B(X) - XB'(X) = 1. This means that is valid 
if and only if / °° e^^^d^x) = for all j > 2 and for all A > 0. This in turn 

implies that B(X) must be a linear function, i.e. B(X) = co + CiA for some constants 
Co and c%. However, because of |-B(A)| < 1, we obtain cq = 1 and ci = 0. This 
corresponds to the trivial case, where the probability distribution function B(x) is 
concentrated in point 0. This case cannot be valid, since A is assumed to be strictly 
positive. Therefore (12. 5p is not the case, and hence (12. 4|) holds. □ 

Let L n denote the number of losses during the busy period T n , and let v n denote 
the number of served customers during the same busy period. 

Using Wald's equations |41| . p. 384, we have the following system. 

(2.6) Ev n + EL n = AET n + 1, 

(2.7) Ei/„ = M ET„, 

where \i denotes the reciprocal of the expected service time. The term AET„ of the 
right-hand side of (|2.6p denotes the expected number of arrivals during a regen- 
eration period excluding the first (tagged) customer, who starts the busy period. 
Equations (|2.6[) and (|2.T[) are similar to those (1) and (2) of paper [8]. 

From these two equations (I2.6|) and (|2.7|) . by subtracting the second from the 
first, we obtain: 

EL n = (A - n)ET n + 1, 

leading to 

(2.8) EL n - 1 = (A - fi)ET n . 

Equation (|2.8p coincides with (7) of [7] which is written under another notation and 
was derived by the different method. From (|2.8[) we obtain the following recurrence 
relation: 

(2.9) EL n - 1 = V(Ei n _ J+1 - 1) / e - Xx[ —LdB(x),EL = -=p. 

Recurrence relation (|2.9p is the same as (3) of [7] and enables us to prove the 
following theorem (see [3], [5] and [7]). 
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Theorem 2.4. If p < 1. then 



lim EL„ = 0. 



If p = I, then for all n > 
(2.10) 

If p > 1, then 



EL„ = 1. 



(2.11) 



lim 



EL„ — 



-0, 



1 + XB'(X - Ay) 



where B(s) = J °° e sa: d-B(a;) is the Laplace- Stieltjes transform of a service time, 
and ip is the least positive root of the equation (|2.3[) • 



Evidently, that the statement of this theorem follows immediately by application 
of Theorem 11.11 In this case we equate iTj with 



and the condition 7r > is equivalent to B(X) > and is satisfied. Then we equate 
7i with p and Qfc with EL^ — 1 and easily arrive at the statement of the theorem, 
where under the condition p > 1, there is a unique root of equation (|2.3p belonging 
to the interval (0,1) (e.g. Takacs [74]). 

The most significant consequence of this theorem is (|2.10[) . This result met 
attention in the literature, and there is a number of papers that devoted to extension 
of this result. We mention [5], [53], [55J, [5J], [95] as well as [H]. On the other 
hand, rel. (|2.10[) is an unexpected generalization of the following elementary result 
from random walk theor jfl (This rando m walk is associated with the Markovian 
M/M/l/n queueing system.) Namely, let X , Xi, . . . be random variables taking 
the values ±1 with equal probability i. Let So = 0. Then S n = X\ + X 2 + . . . + X n 
characterizes a symmetric random walk starting at zero, and r = inf {/ > : Si = 0} 
is the moment of the first return to zero point. Then for any level m ^ 0, the 
expectation of the number of up-crossings across the level m during the random 
time [0, r] is equal to \. 

For p > 1, the asymptotic analysis of ET„ and EL„ of the M/GI/l/n queue- 
ing system has also been provided in Azlarov and Takhirov [18) and Azlarov and 
Tashmanov [19] by methods of the complex analysis. The similar results for the 
GI/M/l/n queue have been obtained by Takhirov [86]. The asymptotic estima- 
tions obtained in these papers have the worse order of the remainder than that 
following from Takacs' thcorcm ll.il 

Theorem 12.41 has been extended in [6J for the case of the M/GI/1 queueing 
system where if an arriving customer meets n or more customers in the queue, then 
he joins the queue with probability p or lost with probability q = 1 — p. 

The case p = 1 + 8 where 8n — >C>0as<5— >0 and n — * oo falls into the area 
of the heavy traffic analysis. Under this assumption we have the following theorem 
(see, Theorem 2 of [7J). 



The result is not widely known. The mention about this result can be found, for example, in 
the book of Szekely [72] . For another relevant consideration see Wolff 94, p. 411 
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Theorem 2.5. Let p = 1 + 5, 6 > 0. Denote pj(S) = (Xx) j dB (x) . A ssume that 
5n^C>0asS>0 and n — > oo. Assume also that p2 — linin— >oo P2(S) and psin) 
is a bounded sequence. Then, 

(2.12) EL n = e 2C /P 2 [l + 0(5)}. 



The proof of Theorem 12.51 uses the expansion for small S 

(2.13) p = l-B + 0(5 2 ). 

obtained in Subhankulov [71j . p. 326 as well as the expansion 

(2.14) 1 + XB'(X-X(p) =S + 0(S 2 ), 

following from the Taylor expansion of B'(X — Xip). 

Using renewal theory and result (|2.13[) . one can obtain the estimation for the 
stationary loss probability for the M/GI/l/n queueing system with large number 
of servers, and the load parameter p = 1 + 6, 6 > 0, &s 5n — > C > 0. 

Let An denote the number of arrived customers during the busy cycle. According 
to renewal theory, for the stationary loss probability Pioss we have: 



1 + F<A n 1 + XET n 

Under the assumption p > 1 , from Theorem 11.11 we have the following expansion 
for EA n : 

(2.15) VA n = ^ + _^_ + (i). 

1 + XB'(X- X(p) 1-P 

Therefore under the assumption p > 1, for Pi oss we obtain: 
(2-16) P loS s = ^^——[1 + ^)]. 

Under the assumption that p = 1 + 6, S > 0, and 8n — > C > we have the 
following result. 

Theorem 2.6. Under the assumptions of Theorem \ 2.5l the following asymptotic 
relation holds: 

(2-17) Ploss = T —J—— [1 + (S)}. 

Similar asymptotic relation for M/GI /1/n queues, under other heavy traffic 
conditions where 5 is a small negative parameter, has been discussed by Whitt [90] . 

3. Consecutive losses in M/GI/l/n queues 

Consecutive losses are very important in performance analysis of real telecom- 
munication systems. They have been studied in many papers, see [28], [29], [30] . 
[35j . [60j . [61j . [62] and many others. A convolution type recurrence relation for 
the distribution of k consecutive losses during a busy period (or stationary prob- 
ability of k consecutive losses) has been obtained in [61] for more general systems 
with batch arrivals. Although the structure of these recurrence relations is simple, 
the notation used there looks complicated. Unfortunately, an asymptotic analysis 
of these recurrence relations or those ones for other numerical characteristics, as 
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n — ► oo, has not been provided neither for the systems with batch arrivals that 
considered in this paper [61], nor for the simpler M/GI/l/n queueing systems. 

We derive now the relation similar to (|2.9|) to the case of consecutive losses 
in M/GI /\/n queueing systems. By fc-CCL probability^ we mean the (limiting) 
fraction of those losses belonging to sequences of k or more consecutive losses (we 
call them fc-consecutive losses) with respect to all of the losses that occur during a 
long time interval. Let E\, E2, ■ ■ ■ , E n be the states of the M/GI/l/n queueing 
system (n. > 1 and the notation for the M/GI/l/n queue excludes a customer 
in service) at the moments of service begins, i.e. states when at the moments 
of service begins there are 1, 2, . . . , n customers in the system correspondingly. 
Suppose that the system is currently in the state Ej (1 < j < n). Then, a loss of 
a customer (at least one) occurs in the case when during the service time of the 
tagged customer, which is currently in service, there are n — j + 2 or more new 
arrivals. This probability is equal to 



i— n— j+2 



-Xx ( Xx ) 



■dB(x). 



On the other hand, for the system that is being in state Ej, there is the probability 

Jo u 



E 

i— n— 



that the losses that occur during a service time, all are /c-consecutive. (In this case 
the number of arrivals during a service time is not smaller than n — j + k + 1.) Let 
qj = P(Ej) (qi + (72 + ■ ■ • + <Zn = !)■ Then, by renewal reward theorem [68] we have 
the following representation: 

3.1 04 = — I 3 —, 

where EX}, j = 0,1,..., n, satisfy recurrence relation (|2.1[) . By using (|3.1[) , for 
the expected number of fc-consecutive losses during a busy period of M/GI/l/n 
queueing system (which is denoted by EL„ ife ) we have: 

(3.2) EX n! fc = c^ELyj, 

where 



(3.3) C n ,k 



Note, that in the case of the M/GI/1/0 queueing system the result is trivial. We 
have: 



The value c n ^ in p.2p is a bounded constant. It approaches the limit as n — > 00. 
Therefore, the asymptotic order of EL n ^ is the same as this of EL n . For example, 
in the case p = 1, EL„ fe < 1 is bounded for all n and therefore converges to the 



2 This terminology is used in 1611 and |62| . 
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limit as n — > oo. (According to the explicit representation (|3.3p there exists the 
limit of c n ,k as n — > oo.) 

The open question concerns the local property of EL^fc when the values n are 
different and p = 1. The question is: whether or not EiL„ t k is the same constant 
for all n > 0. The complicated explicit formula (|3 ,3|) does not permit us to answer 
to this question easily. In all likelihood, this property does not hold in the general 
case. However, in the particular case of exponentially distributed service times, 
the answer on this question is definite: EL^/j is the same for all n. To prove 
this, notice first that when p = 1, we have ET) — ET 3 _i = ^ = j for all j = 
1,2, ... ,n. Therefore, by assuming that B(x) = 1— e~ Xx we arrive at the elementary 
calculations supporting this property. The exact calculations show that in this case 
c n,k = (|) ■ The same result can be easily obtained by an alternative way in 
which, under the assumption p = 1, the Markovian queueing system is represented 
as a symmetric random walk. 

Let us now study the asymptotic behaviour of EL ra ^. The only two cases p = 1 
and p > 1 are considered here. (In the case p < 1 we obtain the trivial result: 
lmijwoo EL^fc = 0.) 

Consider first the case p = 1 and / °° x 2 dB(x) < oo. In this case according to 



(3.4) ETj - ETj_i = — <>{ \ ). 

where 



Theorem 12.31 (which is derivative from Theorem 1 1.3[) . as j —* oo, we have: 

2 

P2 = \ 2 x 2 dB(x). 
Jo 

V™ V°° f°° c~ Xx (Aa:) ' dB(x) 

Z^j=l Z^i=n-j+k+l Jo e i\ UJ:> W 



Therefore, in this case 

lim Cn.k = lim 



(3.5) 



S"i'/o°°e-^^rdg(x) 



J^e-^dB^) 

Therefore, from the known result EL„ = 1 for all n > (Theorem l2.4l) we arrive at 



(3.6) lim EL„ ifc = 



B(\) 

Let us now consider the case p > 1. In this case for the difference ET} — ETj_i, 
as j — > oo, according to Theorem l2.ll rel. (|2.2[) . we have the asymptotic expansion: 

_P y J '~ 1 ( l - ¥>) 

A[1 + AB'(A- A^)] </> 2 

Therefore, 



(3.7) ETj - ETj_i = - — ^ ; 2 V_i + 



(3.8) lim Cn,k = lim 



n — >oo 



EU yi- 1 EZn- J+k+1 £ e^^dB(x) 
EU V*- 1 EZn- j+ 2 C e-^^dB(x) 
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Thus, we have the following theorem. 
Theorem 3.1. If p < 1, then 

lim EL n ,k = 0. 

n — >oo 

If p = 1 and pi = A 2 x 2 dB(x) < oo , then 



lim EL n j. 



If p > \ , then 



lim ^ = Hm ^"=i tl ^T= n - 3+k+ i Jo" e-^^-dflCz) 

where ip is the least positive root of equation (|2-3[) , and EL„ is defined by asymptotic 
expansion (|2.1ip o/ Theorem\2.4\ 



4. Losses in the GI/M/l/n queue 

Loss probabilities in M x /GI/l/n and GI /M Y /1/n queues have been studied 
by Miyazawa [59]. In the special case of the GI/M/l/n queue, from the results of 
Miyazawa [59] we have as follows. 

Let p denote the parameter of service time distribution, let A(x) be probabil- 
ity distribution function of interarrival time, and let A be the reciprocal of the 
expected interarrival time. Denote the load of the system by p = ^ and let 
Pj = J °° (pxy dA(x) . (Notice that p\ = K) 

Miyazawa [33] proved that the loss probability Pi oss = Pioss(n) does exist for 
any p, and3 

(4-1) Ploss — y~>" ' 

2^=0 r i 

where the generating function R(z) of Tj, j = 0, 1, . . ., is as follows: 



(4.2) fl(z) = Er . zJ = a-^-H > w<Vj 

j =0 A{p - pz)- z 

A{s) — J °° e~ sx dA(x), and (p is the least positive root of the equation 

(4.3) z = A(p - pz). 

(For the least positive root of the equation we use the same notation tp as for the 
least positive root of similar equation (|2.3| . We hope, that it does not confuse the 
readers of this survey.) 
From (14.21) we have: 



= (1 - z)A{p - pz) _ A(p - pz) _ z _ A(p - pz) 



(4.4) A(p — pz) — z A(p — pz) — z A{p — pz) — z 

= R{z)-zR(z), 



■^Dependence on parameter n will be omitted. It is only indicated once in the formulation of 
Theorem Ol 
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where 



Note that 



Therefore, 



3=0 



A{p — jj,z) — z 



ro = r , 
Tj+i = rj+i-rj, j>0. 



3=0 

and therefore from (|4.1|) we have 

(4.5) P loss = i. 

The sequence r n satisfies the convolution type recurrence relation of (|1.2j) . Specif- 
ically, 

(4.6) r n =J2rn- j+ i f°° e~^--^dA(x). 

3=0 J ° J ' 

Therefore by applying Theorem 11.11 we arrive at the following theorem (for details 
of the proof see [9]). 

Theorem 4.1. If p < 1, then asn^oo 

(4-7) Pioss = ~- Vo{ip ). 

1 -p-p[l + nA'{n-w>)]<fF 

If p = 1 and p2 < oo, then 
(4.8) 
If p > 1, then 

(4.9) lim P loss = EZI, 

n— >oc p 

Using Tauberian Theorems 11.21 and 11.31 one can improve (|4.8p . In this case we 
have the following two theorems. 

Theorem 4.2. Assume that p = 1 and p^, < oo. Then, as n — > oo, 

(4.10) P loss = ^+o(-^ 

In \ n 

The proof of this theorem follows immediately from Theorem 11.21 
Theorem 4.3. Assume that p = 1 and p2 < oo. Then, as n oo, 

1 1 2 

Pioss{n+l) Pioss(n) p 2 

Proof. The proof of this theorem is similar to that of the proof of Theorem l2.3l □ 



(4.8) lim nP loss = 

n — '■oo Z 
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Choi and Kim [25] and Choi, Kim and Wee [26] study the asymptotic behavior 
of the stationary probabilities and loss probabilities. Some of these results are close 
to the results obtained in Theorems 14.11 and 14.31 For more details see the discussion 
section of [9]. 

The further heavy traffic analysis leads to the following two theorems. 

Theorem 4.4. Let p = 1 — 6, S > 0, and let 5n —> C > as n — » oo and S — ► 0. 
Assume that psin) is a bounded s equence, and there exists p2 — lim n — >oo P2 (^) ■ 
Then, 

X e -2C/p 2 

(4.12) P;oss = ______ [1 + (i)]. 

Theorem 4.5. Let p = 1 — 8, 6 > 0, and let 5n — > as n — > oo and <5 — > 0. ylsswme 
f/iaf Pz{n) is a bounded sequence, and there exists f>2 — linin^oo p2(n). Then, 

P2 , /I 



(4-13) Pioss = _ , 

2n \n 

The proof of the both of these theorems is based on asymptotic expansions, 
which are analogous to those of (|2 . 13[) and (|2.14[) . 

Similar results, related to the heavy traffic analysis of GI/M/l/n queues, have 
been obtained in [5D] , 

5. Losses in the GI/M/m/n queue 

Takacs' theorem has also been applied for analysis of the loss probabilities in 
multiserver GI/M/m/n queueing systems [TT]. An application of Takacs' theorem 
in this case, however, is not entirely straightforward and based on special approxi- 
mations. Specifically, the recurrence relation of convolution type (|1.2|) is valid only 
in limit, and a technically hard analytic proof with complicated notation is required 
in order to reduce the equations describing the stationary loss probability to the 
asymptotic recurrence relation of convolution type (|1.2[) . 

In this section we do not present the details of the proofs. These details of 
the proofs can be found in [TT]. We only formulate the theorems and discuss 
general features and differences between the GI/M/m/n and GI/M/l/n cases in 
the corresponding theorems. 

As in the case m = 1 above, A(x) is the probability distribution function of 
interarrival time, A is the reciprocal of the expected interarrival time, A(s) is the 
Laplace-Stieltjes transform of A(x), where the argument s is assumed to be nonneg- 
ative. The parameter of the service time distribution is denoted by p, and the load 
of the system p = A/ (mp). The least positive root of the equation z = A(mp—mpz) 
will be denoted ip m . The loss probability Pi oss is now dependent of m and n. 

The following theorem on the stationary loss probability have been established 
in Abramov |llj . 

Theorem 5.1. If p > 1, then for any m > 1, 

(5.1) lim P loss = P — — . 

n—>oo p 

If p = 1 and p2 — Jq 00 (px) 2 dA(x) < oo, then for any m > 1, 

(5.2) lim nPi oss = — . 

n— »oo Z 
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If p = 1 and p3 = J^°(mx) 3 dA(x) < oo, then for large n and any m > 1, 
(5.3) 



2ri 



If p < 1, then for Pi oss we have the limiting relation:^ 
(5.4) /',,.., = K, 
where 



(1 - p)[l + (m/x - mn<p m )]<Pm . , 2nN 
Z TT, m n-l + °Wrn J) 

1 — p — p[l + mpA'(mp - mfMp m )\(p m 



(5.5) 



Cj m(l — (Tj) — j 



j J 1 - (Tj m(l - (p„ 



dA(a;), 



J 1 



1=1 ~ ■> 

Relations (|5.ip . (|5.2p and (|5 .4[) follow from Takacs' theorem 11.11 relation (J5T 
follows from Tauberian theorem 11.21 Relations (|5.ip , (|5.2p and (|5.3p are as the 
corresponding results for the GI/M/l/n queue. However, there is the difference 
between (|5.4p and (14. 7\i associated with special representation (|5.5p of the coefficient 
K m , so the analysis of the case p < 1 is more delicate than that in the cases p > 1 
and p = 1. 

By alternative methods, the asymptotic loss and stationary probabilities in 
GI/M/m/n queues have been studied in several papers. The analytic proofs given 
in these papers are much more difficult than those by application of Takacs' theo- 
rem [TTTJ We refer Kim and Choi [48], Choi et al. [27] and Simonot [70], where the 
readers can find the proofs by using the standard analytic techniques. 

It is surprising that in the heavy traffic case, where p approaches 1 from the 
below, we obtain the same asymptotic representation for the loss probability as in 
the GI/M/l/n case. Although the expression for K m (|5.5p looks complicated, its 
asymptotic expansion when p = 1 — 5, 5 > 0, and 5n — > C as n — > oo and 5 — > is 
very simple: 

K m = 1 + 0(6). 
Therefore, we arrive at the following theorem. 

Theorem 5.2. Let p = 1 — 5, 5 > 0, and let Sn — > C as n — > oo and S — » 0. Suppose 
that P3 = P3(n) is a bounded sequence, and there exists p~2 — lim, woo p2 (n) . Then, 
in the case C > for any m > 1 we have 

PloSS ^ _9^/^„ [ 



(5.6) 
In the case C 
(5.7) 



1 _ e -2C/p 2 

for any m > 1 we have 

Ploss — ~Z 

2n 



>(!)]• 



The asymptotic relation, which is presented here, is more exact than that was presented in 
[11] in the formulation of Theorem 3.1 of that paper. 



TAKACS' ASYMPTOTIC THEOREM AND ITS APPLICATIONS: A SURVEY 15 

It is readily seen that the asymptotic representation given by (|5.6p and (|5.7j) 
are exactly the same as the corresponding asymptotic representations of (I4.12|) and 

6. Future research problems 

In the previous sections, applications of Takacs' theorem to queueing systems 
have been discussed. In this section, which concludes Part 1, we formulate prob- 
lems for the future applications of Takacs' theorem to different queueing systems. 
Specifically, we discuss possible ways of application of Takacs theorem to retrial 
queueing systems. 

Consider a single server queueing system with Poisson input rate A and n number 
of waiting places. A customer, who upon arrival finds all waiting places busy, goes 
to the secondary system, and after some random time arrives at the main system 
again. If at least one of waiting places is free, the customer joins the main queue. 
Assuming that service times in the main system are independent and identically 
distributed random variables, one can interest in asymptotic behavior of the fraction 
of retrials with respect to the total number of arrivals during a busy period. 

Assumptions on retrials can be very different. One of the simplest models is 
based on the assumption that times between retrials are independent identically 
distributed random variables, and their distribution is independent of the number 
of customer in the secondary system. In another model times between retrials arc 
exponentially distributed with parameter depending on the number of customers 
in the secondary queue. The most familiar model amongst them is a model with 
linear retrial policy: If the number of customers in the secondary system is j, then 
the retrial rate is 

Asymptotic analysis as n — > oo of the fraction of retrials with respect to the to- 
tal number of customers arrived during a busy period is a significant performance 
characteristic of these large retrial queueing systems. An application of Takacs' 
theorem should be based on comparison of the desired characteristics of retrial 
queueing systems with the corresponding characteristics of the M/GI/l/n queue- 
ing system with losses. Specifically, denoting by L n the number of losses in the 
M /GI /1/n queueing system and by R n the number of retrials in a given queueing 
system with retrials, we interest in finding the values c n supporting the equality 
E_R„ = c n EZ/„. If the properties of the sequence c„ are well-specified (for example, 
there exists a limit or an appropriate estimate), then the application of Takacs' 
theorem to Ei?„ as n — > oo becomes elementary. (The asymptotic behavior of EL n 
is given by Theorem 12.41 ) 

Part 2. Applications to stochastic models of communication systems 
and dam/storage systems 

7. Asymptotic analysis of the number of lost messages in 
communication systems 

In this section we study losses in optical telecommunication networks, where we 
develop the results on losses in M/GI/l/n queues considered in Section 1. We 
discuss the results established in [10] . 

Long messages being sent are divided into a random number of packets which 
are transmitted independently of one another. An error in transmission of a packet 
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results in a loss of the entire message. Messages arrive to the M/GI/1 finite buffer 
model (the exact description of the model is given below) and can be lost in two 
cases as either at least one of its packets is corrupted or the buffer is overflowed. 

The model is the following extension of the usual M/GI/l/n system. We con- 
sider queueing system with Poisson input rate A of batch arrivals. The system serves 
each of these batches, and each service time has probability distribution B(x) with 
mean — . The random batches k ? - are bounded from the above and below, so that 

(7.1) P{ K lower < Kl < K u PP £r } = l. 

Ki is the number of packets associated with the ith message. 
Let us denote 

C = sup jm : ^2 K i ^ N \ > 

and according to assumption (|7.ip there are two fixed values Q lower and ^ u PP er 
depending on TV and p{£ lower < £ < £«pper y _ ^ j^ e ^ £. ^ e tne number of messages 
in the queue immediately before arrival of the ith message. Then the message is 
lost if £j > Q. Otherwise it joins the queue. Q is the ith (generic) random level 
in terms of a number of possible messages in the system. The special case when 
P{fti = 1} = 1 (a message contains a fixed (non-random) number of packets) leads 
to the standard M/GI/l/n queueing system, where n = is the integer part of 

N 
i ■ 

It is also assumed that each message is marked with probability p, and we study 
the asymptotic behavior of the loss probability under assumptions that EC increases 
to infinity and p vanishes. The lost probability is the probability that the message 
is either marked or lost because of overflowing the queue. We demonstrate an 
application of Takacs' theorem as well as Theorems 11.21 and 11.31 for the solution of 
all of these problems. 

The queueing system described above is not standard, and the explicit represen- 
tation for its characteristics can not be obtained traditionally. We will introduce a 
class £ of queueing systems. A simple representative of this class is the system Si 
which has been determined above for which we will establish the balance equation 
for the expectations of accepted/rejected customers in the system which are similar 
to those of (|2.6p and (|2.7p in the case of the standard M/GI/l/n system. Such 
equations will be written explicitly in the sequel. 

In order to define the class £ let us first study elementary processes of the system 
Si. 

Let £i denote the number of messages in the system Si immediately before arrival 
of the ith message, £i = 0, and let s, denote the number of service completions 
between the ith and i + 1st arrivals. Clearly, that 

( 7 - 2 ) 6+1 = & - s i + !{&<Ci}> 

where the term l{f ( <£ ( } in (|7.2p indicates that the ith message is accepted. Obvi- 
ously, that Si is not greater than ^ + l^^}. 

Let us consider now a new queueing system as above with the same rate of 
Poisson input A and the same probability distribution function of the service time 
B(x), but with another sequence £ij ^2r • ■ of arbitrary dependent sequence of ran- 
dom variables all having the same distribution as £. Let denote the number of 
messages immediately before arrival of the ith message (£i =0), and let si denote 
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the number of service completions between the ith and i + 1st arrival. Analogously 
to (17.21) we have 



(7-3) & + i =& -Si + l { f.<f.}- 

Definition 7.1. The queueing system 5 is said to belong to the set E of queueing 
systems if E£, = E£j, Es"j = Es^ and 
P{6 < Ci} = P{& < Ci} for all i > 1. 

Let us now consider an example of queueing system belonging to the set E. The 

example is Ci = C2 = Denote this queueing system by This example is 

artificial, but it helps to easily study this specific system, and together with this 
system all of the systems belonging to this class E. 

Specifically, for this system 1S2 according to the induction for alH > 1 we have: 

(7.4) Es, = Est, 

(7.5) P{1 < Ci} = P{& < CO, 
and 

(7.6) E& - Esi + P{1 < CJ = E& - Esi + P{& < Ci}. 



Relations (J7T4J) , (J775J) and (IT.6[) enable us to conclude that S2 £ E. Furthermore, 
from these relations (|7.4| . (|7.5p and (|7.6|) all of characteristics of all of queueing 
systems from the class E do exist and are the same. Therefore, for our conclusion 
it is enough to study the queueing system 1S2, which is the simplest than all other. 

Let denote a busy period of system 52- By the formula for the total expec- 
tation 

^zipper 

(7.7) ET C = ]T ET,P{C = *}, 

where ETi is the expectation of the busy period of an M/GI/l/i queueing system 
with the same interarrival and service time distributions. The expectations ET^ are 
determined from the convolution type recurrence relations of (|2.ip , and all of the 
results of the above theory related to M/GI/l/n can be applied here. Then one 
can write ET^ = ET^, and therefore for the queueing system Si we have the same 
relation as (17.711: 



^upper 

(7.8) ET^ = Yl ET.PIC^}, 

Along with the notation for the busy period of the queueing system Si we 
consider also the following characteristics of this queueing system. Let 1^ denote an 
idle period, and let P^, Mq and denote the number of processed messages, the 
number of marked messages and the number of refused messages respectively. We 
will use the following terminology. The term refused message is used for the case 
of overflowing the buffer, while the term lost message is used for the case where a 
message is either refused or marked. The number of lost messages during a busy 
period is denoted by Lq. Analogously, by lost probability we mean the probability 
when the arrival message is lost. 
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Lemma 7.2. For the expectations ET^, EPf, EM(, EP<^ we have the following 
representations: 



(7.9) 

(7.10) 

(7.11) 



EP C = M ET C , 
EM C = pEP c , 
EP C = (p- 1)EP C + 1. 



The proof of this lemma is based on Wald's equations |41| . p. 384 and similar to 
the proof of relation (|2.8[) from the system of equations (|2.6[) and (|2.7p . The relations 
(|7.8|) . (|7.9|) . (|7.10|) and (|7.11|) all together define all of the required expectations, 
and all of them are expressed via recurrence relation of convolution type. Therefore, 
one can apply Takacs' theorem and Tauberian theorems 11.21 and 11.31 

Denote: pj = J °° (Xx) J dB (x) , j = 1,2,.. ., where according to the earlier nota- 
tion p = p\ is the load parameter of the system. 

We write C = C(N) to point out the dependence on parameter N. As N tends 
to infinity, both £ lower and i^ u PP er tend to infinity, and together with them C(-^0 
tends to infinity almost surely (a.s.) For the above characteristics of the queueing 
system we have the following theorems. 



N- 



Theorem 7.3. If p < 1, then 
(7.12) liin EP 

If p = 1 and pi < oo ; then 
(7.13) 

If p > 1, then 
(7.14) lim EP. 



lim 

iV->oc 



EP 



EC(iV) 



2 

P2' 



JY- 



E^Wfl + AB'CA-Ay)] 



where B(s) is the Laplace- Stieltjes transform of the probability distribution function 
B{x) and ip is the least positive root of equation z = B(X — Xz). (See rel. (|2.3[) . ) 



Theorem 7.4. If p = 1 and p% < 00, 



(7.15) 



EP 



C(N) 



then 
2 

h 

92 



O (log TV). 



Theorem 7.5. If p < 1, then 
(7.16) 

If p = I, then for all N > 
(7.17) 

If p > 1, t/ien 



lim EP 



0. 



EP, 



C(N) 



(7.18) 



lim 



N- 



EP, 



P-1 



E^W[1 + AP'(A- Xip)} 



= 0. 
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Theorems 17.31 and 17.41 follow from the corresponding Takacs' theorem and Post- 
nikov's Tauberian theorem 11.21 Theorem 17.51 follows from Takacs' theorem and is 
an analogue of Theorem 12.41 on losses in M/GI/l/n queues. Relation (|7.17p says 
that the remarkable property of losses under the condition p = 1 remains the same 
as in the case of the standard M/GI/l/n queueing system. The details of proofs 
for all of these theorems as well as the following theorems of this section can be 
found in [10] . 

In the case where the number of packets in each message is considered to be 
fixed, then from Postnikov's Tauberian Theorem 11.31 we have as follows. 

Theorem 7.6. If p = 1 and p2 < oo, then as n — » oo, 
(7.19) EP„ +1 -EP n = — + o(l), 

where the index n+ 1 says that P n +i is the number of processed messages during a 
busy period of the M/GI/l/n + 1 queueing system. 



Note, that the proof of Theorem l7.6l is based on application of Tauberian Theo- 
rem 11.31 and is exactly the same as the proof of Theorem 14.31 
Under heavy traffic conditions we have as follows. 

Theorem 7.7. Let p = 1 + S, 8 > 0, and 5((N) -> C > a.s. as N -> oo 

and S — > 0. Assume also that ps = Pa(N) is a bounded sequence, and there exists 
p 2 = liniAT^oo p2(N). Then, 

2C/p 2 _ 1 

(7.20) EP C(W) = +0(1), 

(7.21) Ei? (m = c 2C ^ + o(l). 

Theorem 7.8. Let p = 1 + 5, S > and S((N) — > a.s. as N — » oo and 

5 — * 0. Assume also that p^ = pa(N) is a bounded sequence, and there exists 
p 2 = liniAT^oo pz(N). Then, 

(7.22) EP c(Ar) = J-EC(iV) + 0(1), 

P2 

(7.23) ER C{N) = l + o(l). 

Asymptotic behavior of the loss probability can be deduced from the above 
asymptotic theorems by using renewal arguments. According to renewal arguments, 
the loss probability is 

EP C _ EP C + EM C _ ER C + P EP C 
[ ' ' C ER C + EP C EP C + EP C EP C + EP C ' 

where p is the probability of losing a message, because one of its packets is corrupted. 
We have as follows. 



Theorem 7.9. If p < 1, then 
(7.25) lim n cw =p. 

Limiting relation (|7.25p is also valid when p = 1 and p 2 < oo. If p > 1, then 

p-l (p - 1) + p[l + XB'(X - Ay)]E/( JV ) 
P (p - 1) + [1 + AS'(A - Xtp)]EtpC(N) 



(7-26) n c(A0 = Elfpl . ( r^ +P I 1+ ^ A ". A ^r + o(E^). 
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Theorem 7.10. If p = 1 and ps < oo, then as N — > oo, 
(7-27) n c(JV) = P + +0' 



2E<(iV) V ^ 2 

If under the assumptions of Theorem 17.91 to assume additionally that p — > 0, 
then in the case piV -^C>0asp— +0 and N — > oo we have: 

C , p 2 , ,-, /logA^ N 



In the case pN — ► as p — > and JV oo we have: 
tt _£2_^n( 

Theorem 7.11. lei p = 1 + 8, S > 0, and 6((N) —> C > as N —> oo and 5 > 0, 
and letp—>0. Assume also that p% = ps(N) is a bounded sequence, and there exists 
p 2 = limjv->ao p 2 (N). 

(i) If2->D> 0, then 

/ e 2C/p 2 \ 

(7.28) IL c{N) =(D+ e2C/?2 _ 1 )5 + o(5). 

(ii) oo, then 

(7.29) n c(JV) = P + 0(S). 

Theorem 7.12. Let p = 1 + 6, 6 > 0. and S((N) — > as N — > oo and (5 > 0, and 

Ze£ p — » 0. Assume also that pz = Pz(N) is a bounded sequence, and there exists 
p 2 = limAr^oo p 2 (N). 
(i) //£ _►£) > 0, ZAen 

(7.30) n c(Ar) = p + _ P2 _ + o ' 1 



2EC(iV) 

fitij If Q —* oo, then we have (|T.29[> . 

In the special case where each message contains exactly Z packets, n — we 
have as follows. 

Theorem 7.13. If p\ = 1 and p 2 < °°> then as n — ► oo 

,1(71 + 1) ~~ ^ /I 



n„+i — n r , 











\P2 




\P2 





,2 



Asymptotic Theorems l7.9l - [7.12l on loss probability enable us to make conclusion 
on adding redundant packets into messages. The standard assumption given in [10] 
is that a redundant packet decreases probability p by 7 times but increases the 
load of the system by 7 times. The analysis in [10] showed that in the case p < 1 
the adding a number of redundant packets can decrease the loss probability with 
geometric rate while p < 1. It was also shown that in critical cases where p = 1 + S 
adding redundancy can be profitable as well. The details of the analysis can be 
found in [TU] . 

There is a large number of papers in the literature on communication systems and 
networks studying related problems on analysis of losses and adding redundancy. 
We refer [IB], [T7J, [3T], [35], [37], [12] to only mention a few. All of these papers 
use analytic techniques for the solution of one or other problem. 
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8. New asymptotic results for the number of lost messages in 
telecommunication systems 

In this section we continue to study the asymptotic behavior of the number 
of lost messages in optical telecommunication systems. More specifically, in this 
section we apply the results of Sect. [3] to establish the asymptotic results for 
consecutive refused messages of the model described in the previous section. As in 
the previous section the phrase refused message is used to indicate that the message 
is lost by overflowing the buffer, and in this section we provide new results just for 
consecutive refused messages. For the number of fc-consecutive refused messages 
we use the notation R(;(N),ki i- e - we only add the index fc to the previous notation 
R(;(N) used in the previous section. 

According to Lemma 17.21 

ER C(N) = (p-l)EP c(JV) , 

and 

(see rel. ()7.9[) and (|7.11j) ). where P((n) is the number of processed messages during 
a busy period 2^(7v). 

The expectation ET^^r) is in turn found by using the total probability formula 

(-upper- 
flower 

(see rel. (|7.8p ). where Ti is the length of a busy period in the M/GI/l/i queueing 
system. The asymptotic analysis of ET^jv) and ER^^ is based on asymptotic 
behavior of ET„ and the results of that analysis for ER^^) is given by Theorem 
17.51 Similarly to l|7.8j) . the above total probability formula can be written for 
Ei?£(Ar), so we have: 

(-upper- 

EV)= J2 ELiP{C(iV) = »}, 

where L; denotes the number of losses during a busy period of the M/GI/l/i 
queueing system. Therefore, the results of Sect. [3] can be applied immediately 
here. 



Theorem 8.1. If p < 1, then 



lim Ei? c(A n fc = 0. 



If p = 1 and p2 = A 2 J Q x 2 dB(x) < oo, then 



lim ER, 



C(N),k 



(i+k)\ 



N^oo ^ " B(\) 

If p > 1, then 

Um KRg N) , k = Um gLr ^ Egiv-j+fc+i £ e-^dB(x) 
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where ip is the least positive root of equation (|2.3[) . and Ei?^(7v) is defined by as- 
ymptotic expansion (|7. 18|) of Theorem \ 7. 5\ 

Other new results on asymptotic behavior of Ei?^(jy),fc a s N — > oo can be obtained 
by the further analysis of the results obtained in Sect. [3J and [7] Similarly to 
Theorems 17.71 and 17.81 we have the following theorem. 



Theorem 8.2. Let p = 1 + S, S > 0, and 5((N) -> C > a.s. as N -> oo 

and S — > 0. Assume also that p% = p^{N) is a bounded sequence, and there exists 
p 2 = limAT^oo p2(N). Then, 



V°° i f°° c~ Xx (Xx) dB(x) 

M C(JV),t - e ^ g— + o(l). 

#(A) 



9. Optimal policies of using water in large dams: A simplified model 

In this section we discuss an application of Takacs' theorem to optimal control 
of a large dam. We consider a simple variant of this problem given in [12]. The 
extended version corresponding to [T3J will be discussed in the next section. 

The upper and lower levels of a dam are denoted L upper and L lower correspond- 
ingly, and the difference between the upper and lower level n = L upper — L lower 
characterizes the capacity of this dam. The value n is assumed to be large, and 
this assumption enables us to use asymptotic analysis as n — > oo. 

We assume that the units of water arriving at the dam are registered at random 
instant t\, t%,- ■ ■ , and the interarrival times, t„ = t n+ i — t n , are mutually inde- 
pendent, exponentially distributed random variables with parameter A. Outflow 
of water is state dependent as follows. If the level of water is between L lower and 
jjupper then the dam is said to be in normal state and the duration time between 
departure of a unit of water has the probability distribution function B\(x). If the 
level of water increases the level L upper , then the probability distribution function 
of the interval between unit departures is B2(x). If the level of water is exactly 
L iotoer , then the departure process of water is frozen, and it is resumed again as 
soon as the level of water exceeds the value L lower . 

In terms of queueing theory, the problem can be formulated as follows. Consider 
a single-server queueing system with Poisson arrival stream of rate A. The service 
time of customers depends upon queue- length as follows. If at the moment of a 
beginning of a service, the number of customers in the system is not greater than ra, 
then this customer is served by probability distribution function B\{x). Otherwise 
(if at the moment of a beginning of a service, the number of customers in the 
system exceeds n), then the probability distribution function of the service time of 
this customer is B2(x). Notice, that the lower level L lower is associated with an 
empty dam. The dam specification of the problem is characterized by performance 
criteria, which in queueing formulation is as follows. 

Let Q{t) denote the (stationary) queue-length in time t. The problem is to 
choose the output parameter of the system (parameter of service time distribution 
Bi(x)) so to minimize the functional 

(9.1) J(n) =pi(n)Ji(n) +p 2 (n)J 2 (n), 

where pi(n) = lim t ^oo P{Q(t) = 0}, P2(n) = lim t _ ! . 00 P{Q(i) > n}, and Ji(n), 
J 2 {n) are the corresponding damage costs proportional to n. To be correct, assume 
that J\(n) = jin and J2(n) = jiri, where j\ and j% are given positive values. 
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Assuming that n — > oo we will often write the p\ and p 2 without index n. The 
index n will be also omitted in other functions such as Ji, J2 and so on. 

We will assume that the input rate A and probability distribution function B2 (x) 
are given. The unknown parameter in the control problem is associated with prob- 
ability distribution function B\(x). We will assume that B\{x) — B\{x,C) is the 
family of probability distributions depending on parameter C > 0, and this param- 
eter C is closely related to the expectation J" °° xdB\ (x) . Then the output rate of 
the system in the normal state is associated with the choice of parameter C > 
resulting the choice of Bi(x, C). 

We use the notation — = J °° xdBi(x), and pi — — for i = 1,2. We assume 
that P2 < 1, and this last assumption provides the stationary behavior of qucueing 
system and existence of required limiting stationary probabilities p\ and pi (inde- 
pendent of an initial state of the process). In addition, we assume existence of the 
third moment, p\ k — J (Xx) k dBi(x) < 00, k — 2,3. 

For the above state dependent queueing system introduce the notation as follows. 
Let T„, /„, and v n respectively denote the duration of a busy period, the duration 
of an idle period, and the number of customers served during a busy period. Let 
Tn^ and Tn respectively denote the total times during a busy period when < 
Q(t) <n and Q(t) > n, and let Vn and Vn^ respectively denote the total numbers 
of customers served during a busy period when < Q(t) < n and Q{t) > n. 

We have the following two equations 

(9.2) ET n = ETW+ET^ 2 ), 

(9.3) Ei/ n = E1/W+E1/W. 
From Wald's equation [41], p. 384, we obtain: 

(9.4) ET 7 {^ = -E^ 1 ), 

Mi 

(9.5) ET^ = —E^. 

M2 

The number of arrivals during a busy cycle coincides with the total number of 
served customers during a busy period. By using Wald's equation again we have 

Ez/W + E^ 2) = AET„ + AE/ n 

(9.6) = AET " + 1 

= A (ETW + +1. 

Substituting (|9 .4(1 and (|9.5[) for the right-hand side of (|9.6p . we obtain: 

(9.7) Ev^ + E^ = P1 E^ + P2 Ev^ . 
From (|9.7p we arrive at 

(9-8) E^^^-^E.W, 

1 — Pi 1 - Pi 

which expresses Ev^f 1 in terms of Evn \ For example, if pi = 1 then for any n > 
we obtain 

(9.9) E,^ = - J-. 

I- Pi 
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(2) 

That is in the case p\ = 1, the value Ev\ is the same for all n > 0. This property 
is established in [5] together the aforementioned property of losses in M/GI/l/n 
queues (see relation (|2.10l) ) . 

Similarly, from (|9.5|) and (|9.8p we obtain: 

(9 10) ET^ = — ^— ET^ 

From equations (|9.8[) and (|9 . 1 0|) one can obtain the stationary probabilities p\ 
and P2- By applying first renewal reward theorem (see e.g. [68 ) and then (|9.6[) and 
for pi and p 2 we obtain: 

EI n 1 1 - p 2 



(9.11) Pl = — ^ 

(9.12) p 2 = 



E7T ; + ETi 2) + EI„ Ei/£ 1} + Ei/£ 2) 1 - (pi - p 2 )E^ 1} ' 
ET ? 1 2) p 2 E^ 2) P2+p 2 (pi-l)E^ 1) 



ETi 1} + ETi 2) + E/„ Ei/^+Ei/j? 5 1 + ( Pl - i o 2 )E^ 1) 

Thus, both probabilities p\ and p 2 are expressed via Ei/„ . Our next arguments 
are based on sample path arguments and the property of the lack of memory of 
exponential distribution. Using all of this, one concludes that the random variable 
Vn coincides in distribution with the number of customers served during a busy 
period of the M/GI/l/n queueing system. This characteristics has been discussed 
in Section 2. According to Wald's equation we have the representation similar to 
(12~T|) . Specifically, 

(9.13) E„« =f^E(^. +1 ) fe-^dB^x), 



3- 



where , k = 0, 1, . . . , n — 1, are the numbers of served customers during a busy 
period associated with similar queueing systems (i.e. having the same rate A of 
Poisson input and the same probability distribution functions Bi(x) and B2(x) of 
the corresponding service times) but only defined by parameters k distinguished 
of n. As n — > oo, the asymptotic behavior of Evn can be obtained from Takacs' 
theorem. In turn, the stationary probabilities p\ and P2 are expressed via Ev^\ 
and therefore we have the following asymptotic theorem. 

Theorem 9.1. If pi < I, then 

(9.14) lim pi(n) = 1 — pi, 

n — >oc 

(9.15) lim p 2 (n) = 0. 



If Pi = 1, then 

(9.16) lim npi(n) 

n — >oc 

(9.17) lim np 2 (n) 

n — >oo 

If pi > 1, then 



Pl.2 

2 ' 

P2 Pl.2 

1 " P2 ' 2 



(9.18) lim = M±M1, 

ra->oo (p n p 1 — p 2 
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where -Bi(s) is the Laplace- Stieltjes transform of B\(x), and ip is the least positive 
root of equation z = B\{\ — Xz), and 

(9.19) lim p 2 {n) = E^El^A. 

n->oo p 1 — p 2 

Let us discuss a relation of Theorem 19.11 to optimal control problem. Under 
the assumption that pi < 1, relations (|9.14[) and (|9 . 1 5[) enables us to conclude as 
follows. The probability p\ in positive in limit, while the probability p 2 vanishes. 
Therefore, in the case p\ < 1 we have J» (1- Pi)Ji, so J increases to infinity 
being asymptotically equivalent to (1 — p\)j\n. The similar conclusion follows from 
(|9.16p and (|9.17[) under the assumption pi > 1. In this case the probability p\ 
vanishes, while the probability p 2 tends to the positive limit *f£fz^y- This enables 
us to conclude that J increases to infinity together with n increasing to infinity 
being asymptotically equivalent to 7^~^ J2 n ' I n the case pi = 1 both pi and 
P2 vanish at rate O (— ), and J therefore converges to the limit as n — > oo. Thus, 
pi = 1 is a possible solution to the control problem, while the cases pi < 1 and 
pi > 1 are irrelevant. In the case pi = 1 we have as follows: 

(9.20) hm J(n) = ji— 

According to the result of (|9.20p , the class of possible solutions to the control 
problem can be described by the following two cases, in both of which 8 — > (8 > 0) 
and n — ► oo: (i) pi = 1 + 5; (ii) pi = 1 — 8. 

In case (i) we have the following two theorems. 

Theorem 9.2. Assume that pi = 1 + 8, 8 > 0, and f/iaf n<5 — > C > as 8^0 

and n — > oo. Assume that pi.3 = pi^(n) is a bounded sequence and that the limit 
pi 2 =lim n _K X) /?i 1 2(n) exists. Then, 

(1 - p 2 )(e 2G / pi < 2 - 1) 
Theorem 9.3. Under the conditions of Theorem ] 9. OA assume that C = 0. Then, 

(9.23) lim npi(n) = 

n — >oo 2 

(9.24) lim np 2 (n) = ■ 

n—>oo 1 — p 2 2 

The proof of these two theorems is based on the above expansions given by (|2.13|) 
and (|2.14[) , and thus the proof is similar to the proof of aforementioned Theorems 
12.51 and 12.61 For details of the proofs see [T^] . 

In case (ii) we have the following two theorems. 

Theorem 9.4. Assume that pi = 1 — 8, 8 > 0, and that n8 — > C > as 8^0 

and n — > 00. Assume that pi^ = pi,3(n) is a bounded sequence, and that the limit 
pi :2 = Hindoo pia(n) exists. Then, 

(9.25) pi = (Se ?1 - 2/2C + o((5), 

(9.26) p 2 = S— P — (e ?1 < 2 - 1) +0(6). 

1 - Pi 
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Theorem 9.5. Under the conditions of Theorem \9.4\ assume that C = 0. Then 
we obtain (f9T23|) and ([9T241 . 



Theorems 19.41 and 19.51 do not follow directly from other theorems as this was in 
the case of Theorem [921 which is derived from 19. ll by using appropriate asymptotic 
expansions. The proof of Theorem l9.4l is based on Tauberian theorem of Hardy and 
Littlewood which can be found in many sources (e.g. [65], [71], [73], [75] , P- 203 
and [89]). Below we give the proof of Theorem 19.41 based on the aforementioned 
Tauberian theorem. 

We have the representation 

V Eu^z n = ^ l(A ~ Az) 

" B 1 (X-Xz)-z' 

which is the consequence of (jl.3[) . The sequence jE^''} is increasing, and, for 
pi = 1, from the aforementioned Tauberian theorem of Hardy and Littlewood we 
have 

rwoo n It i B 1 (X-Xz)-z 
In the case pi = 1 — S and 5n — * C as n — > oo and 5^0, according to the same 
Tauberian theorem of Hardy and Littlewood, the asymptotic behavior of Ei/i 1 '' can 
be found from the asymptotic expansion of 

B(X - Xz) 



(9.27) (1-2)- 

B(X-Xz)-z 

as z 1 1. Expanding the denominator of (|9.27|) to the Taylor series, we obtain: 
1- z _ l-z 
B(X-Xz)-z = l-z- Pl (l -z) + (?i, 2 /2)(l - zf + 0((1 - zf) 

1 

(9 28) " 5+(p ia /2){l-z) + 0{{l-zY) 



5[l + (p h2 /26)(l-z) + 0((l-z)*)] 



5exp((pi ;2 /25)(l-z)) 
Therefore, assuming that x = (n-l)/n->lasn-> cxd, from (|9.28p we have: 

( 9 - 29 ) ^-j^cil + oil)). 

Substituting (|9.29p into (|9.1ip and (|9 . 1 2[) we arrive at the desired statement of 
Theorem 19.41 The proof of Theorem 19. 51 is similarly based on the above expansion. 

Above Theorems 19.21 - 19.51 enable us to solve the control problem. We have the 
following limiting relation: 

lim J(n)= \\vn\pi(n)Ji{n) + p 2 {n)J 2 {n)] 

(9 30) n^-oo n— >oo 

= ji lim npi (n) + j 2 lim np 2 (n) . 

n — >oo n — >oo 

According to the cases (i) and (ii) we have two corresponding functionals. Specif- 
ically, substituting (|9.21|) and (|9.22p into the right-hand side of (|9.30|) and taking 
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into account that n5 — > C we obtain: 



(9.31) J upper = C 



1 . p 2 e 2C/pi ' 2 



31 - 1 + 32 (l - P2 )(e 2C, /w^ - 1) 



Next, substituting (|9.25p and (|9.26p into the right-hand side of (|9.30[) and taking 
into account that nd — » C we obtain: 



(9.32) J lower = C 



iie ^/2C +i2 _^_ (e ?M/2C_ i: 



1-/02 

An elementary analysis of functionals (|9.3ip and (|9.32p shows, that the minimum 
of the both of them is achieved under C = if and only if 

(9.33) h=jiz J*-. 

1-/92 

More detailed analysis of these functionals (|9.31|) and (|9.32[) (see [12]) leads to 
the following solution to the control problem. 

Theorem 9.6. If the parameters A and pi are given, then the optimal solution to 
the control problem is as follows. 
If 

. 92 

3i =32-, , 

1-/92 

then the optimal solution to the control problem is achieved for p\ = 1 . 
If 

■ ^ . 92 
3i > 32- , 

1-/92 

then the optimal solution to the control problem is a minimization of the functional 
jupper _ y/ie optimal solution is achieved for pi = I + S, where S(n) is a small 
positive parameter and nS(n) —* C , the nonnegative parameter minimizing (|9.3ip . 
If 

. 92 
3i < 32-. , 

1-/02 

then the optimal solution to the control problem is a minimization of the functional 
jlower _ pi{ ma \ solution is achieved for pi = 1 — S, where S(n) is a small 

positive parameter and nS(n) —> C , the nonnegative parameter minimizing (|9.32p . 

There is a large number of papers in the dam literature concerning different 
optimal control problem of water of storage resources. To indicate only a few of 
them we refer [J, g], [5D], gU], [ST], [SJ] and [HSJ. However, the optimal control 
problem of dams and its solution, which is discussed in this section of the paper, 
specifically differs from all of the earlier considerations known from the literature. 
In the next section we discuss a more extended control problem of large dams. 



10. Optimal policies of using water in large dams: An extended 

MODEL 

In the previous section we found optimal solution to the control problem of 
minimization the objective function 



J =PiJi +P2J2, 
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where p\ and P2 are stationary probabilities of passage across the lower and upper 
levels of a dam, i.e. 

pi = lim P{L f = L lower }, 

t^OQ 

p-2 = lim P{L t > L upper }, 

t — >oc 

L t denotes the water level in time t, and J\, J2 are the cost functions having the 
form: J\ = j\n and J2 — jin. The extended problem considered in this section is 
the problem of minimization of the functional 

L upper 

(10.1) j =piJi+p 2 j2+ 

i=L lower +l 

where 

(10.2) q t = lim P{L t = L lower + i}, i = 1, 2, . . . , n, 

t — >oo 

and Ci is the water cost when the level of dam is equal to i. The costs Ci are assumed 
to be decreasing in i, i.e. Cj+x < Ci for all 1 < i < n — 1. (The water is cheaper 
when the dam level is higher.) 

In queueing formulation the level L lower is equated with an empty queue. The 
qucucing formulation of the dam model is given in the previous section. All of the 
assumptions for that state-dependent queueing system remains the same. 

It was shown in the previous section that the probabilities p\ and P2 are expressed 
via Ei/n 1 ^ (relations (|9. 1 1|) and (|9.12|) ). and the asymptotic representations of p\ and 
P2 is derived from the asymptotic formula of Ei/^ ■ The stationary probabilities 
qi, i = 1,2, ...,n can be obtained from renewal arguments (see e.g. Ross [55]). 
Namely, for i = 1, 2, . . . ,n we have: 

(1 °- 3) qi = ET„ + EI n ■ 

(EI^ 1 ^ means the expectation of the total time that the customers are served by 
probability distribution function B\ (x) during a busy period of the state-dependent 
system, which is distinguished from the described system only by parameter i given 
instead of the original parameter n. According to sample-path arguments and the 
property of the lack of memory of exponential distribution (these arguments are 
given in the previous section), the random variable coincides in distribution 
with a busy period of the M/GI/l/i queueing system.) The probabilities q^, i = 
1,2, ... ,n, given by ()10.3[) . can be also rewritten 

(10.4) qi=pi ^-^ LA. 

The equivalence of (| 10 .3[) and (|10.4[) follows easily from the equations Ei^ 1 ' = 
^lElf } for all z = 0, 1, . . . , n, and Eff ) = AET„ + AE/„, which are Wald's equa- 
tions. 

Representation (|10.4[) can also be rewritten in other forms, which are more con- 
venient for our purposes. Recall that (see relation (|9.8p ~) 

1 



1-/92 1-P2 
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and therefore, taking into account that Ez/„ = Ei4, + F>i/n \ we also have: 
(10.5) = -J— + ^*»Ei£>. 

1-/92 1-/02 

Then elementary substitution of (|10.5[) into (|10.4[) gives us 

(10-6) ft = (1) (e*« - ) , i = 1, 2, . . . , n. 

1 + (pi - p 2 )E^ iJ v y 

Comparison with (|9. 1 1|) enables us to rewrite (110. 6|) in the other form: 
(10.7) = p xV x ( E^ (1) - E^\) , % = 1, 2, . . . , n. 



Let us now discuss the different cases as (i) p\ — 1, and for sufficiently small 
<5 > (ii) pi = 1 + S, and (iii) pi = 1 — S. 

We start from case (i). In this case we have the following result. 

Theorem 10.1. If p\ = 1 and p2 < oo, then for all i = 1,2, ... ,n 

(10.8) lim nq n -i = 1. 

n — >oc 

The proof of this theorem is based on application Tauberian Theorem 11.31 
Namely, from that Tauberian theorem we have as follows. 

Lemma 10.2. Under the conditions of Theorem ] 1 0. 1\ for any j > we have 

(10.9) E^l j -EvW j _ 1 = — +o(l), 

Pl,2 

as n — > oo . 

Then, the statement of Theorem 110.11 follows by application of Lemma I10.2[ 
i.e. by substitution Q10.9P into (| 1 . 7[) and consequent application of relation (|9.16|) 
of Theorem 19.11 Notice, that just Tauberian theorem 11.31 is applied here, since 
the appropriate statement of Takacs' theorem is not enough in order to prove the 
required statement of Theorem 110.11 

In turn, Theorem 1 1 . 1 1 leads to the following result. 

Proposition 10.3. Under the conditions of Theorem \10.1\ we have 

(10.10) Um J(n)=il _i_ +i2 ____._i_ + c * ) 

n— >oo Z 1 — p2 I 

where 

1 - 

c* = lim — y C{. 

n — >oo 77, ^ — ' 
i=l 

Notice, that the only difference between (|9.20[) and representation (|10.10p is in 
the presence of the term c* in (|10.10[) . 

In case (ii) we have the following theorem. 

Theorem 10.4. Assume that p\ = 1 + 6, S > and n5~^C>0as5^Q 
and n — > oo. Assume also that pi^(n) is a bounded sequence and there exists 
Pi. 2 = linin^oo pi^(n). Then, for any j > 
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The proof of this theorem is based on the expansion 



Ev 



(i) 



1 



1 + \B[{\ - 



1-Pi 



which is the consequence of an application of Takacs' theorem to recurrence relation 
(|9.13[) , as well as expansions (|2. 13[) and (|2. 14[) . 
From Theorem 110.41 we have the following result. 

Proposition 10.5. Under the assumptions of Theorem \10-4\ let us denote the ob- 
jective function J by J u PP er . We have the representation 



(10.12) 

where 

(10.13) 



juppe 



c 



i 



ac/pt 



l 



.72 



2C_ 

Pi,2 e 20 /? 1 - 2 - 1 



(l-p 2 )(e 2C /^ -1) 
2C 



upper 



lim C n 1 



Pl,2 n 



and C n (z) — X^=o c n-j z3 is a backward generating cost function. 

For details of the proof see [13] • 
Notice, that the term 



C 



Ji- 



e 2C/p 1>2 _ 1 ' Ja-p _ p2 )( e 2C/p lt2 _ X )_ 
is the value of the function J u PP er for the model where the water costs have not been 



P2& 



2C/pi,2 



taken into account (see relation (|9.31[) V So, the function 



upper 



given by (|10.13|) is 



a new element for the function J u PP er . 

Case (iii) is more delicate. The additional assumption that required here is that 
the class of probability distributions {Bi(x)} is such that there exists a unique root 
r > 1 of the equation 

(10.14) z = B(X-Xz), 

and there also exists the derivative B'(X — At). In general, under the assump- 
tion that pi < 1 the root of equation (|10.14[) not necessarily exists. Such type 
of condition has been considered by Willmot [91j in order to obtain the asymp- 
totic behavior for the probability of high-level queue-length in stationary M/GI/1 
queueing systems. Let qi[M/GI/l], i = 0, 1, . . . denote the stationary queue-length 
probabilities. Willmot [91] showed that 

(l-pi)(l-r) 



(10.15) 



q t [M/GI/l] = 



-[l + o(l)}, 



t 1 [1 + XB'(X-Xt)} 
oo. On the other hand, there is the following representation: 



(10.16) 



Qi[M/GI/l] = (1 — pi) (E 



X 1 ) 



Ei/ 



(i) 



i=l,2,. 



which agrees with the well-known Pollaczek-Khintchin formula (e.g. Takacs [74], 
p. 242). 

From (|10.15|) and (|10.16|) for any j > we have the following asymptotic pro- 
portion: 



(10.17) 



(i) 



E;/ Ti 
- Eu. 



(i) 



T j [l + 0(1)}. 
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In order to formulate and prove a theorem on asymptotic behavior of stationary 
probabilities qi for case (iii) we assume that the class of probability distributions 
{Bi(x)} is as follows. Under the assumption that p\ = 1 — 6, 6 > 0, and 5^0 and 
n — > oo, we assume that there exists the value eo > small enough (proportionally 
to 5) such that for all < e < eo the family of probability distributions Bx >e (x), 
provided now by parameter e, satisfies the following condition: its Laplace-Stieltjes 
transform Bi >e (z) is an analytic function in a small neighborhood of zero and 

(10.18) B[ JXe) < oo. 

We have the following theorem. 

Theorem 10.6. Assume that the class of probability distributions B\^{x) is defined 
according to the above convention and satisfies (|10.18[) . Assume that p\ = 1 — 5, 



(10.19) 



Qn—j 



e 2C/p 1<2 _ 1 



1 



S > 0, and n5^C>0as5>0 and n — » oo. 
sequence and there exists p~2 = lirrin^oo px^{n). 

28 1 

Pi, 2 

for any j > 0. 

The proof of this theorem uses the expansion 

t = 1 



Assume that pi^n) is a bounded 
Then, 



26 

Pi, 2 



[l + o(l)] 



Pi, 2 



which is similar to the expansion of (|2. 13|) (for more details see [13]). 
From this theorem we arrive at the following proposition. 

Proposition 10.7. Under the assumptions of Theorem 1 1 0. 61 denote the objective 
function J by J lower . We have the following representation: 

lower /~r „■ „3i.2/2C i „• P2 



(10.20) 
where 
(10.21) 



J 



C 
2C 

Pi, 2 



1 - p 2 V ; 



a 2C/pi 



lim -C„ ! I 



lower 



1 n— *oo XI 



2C_ 

pi,2n 



and C(z) = J^^_ Cn-jZ-* is a backward generating cost function. 



For details of the proof see [13] • 
Notice, that the term 



C 



3ie 



P1.2/2C 



32- 



P2 



^ e Pl,: 



/2C 



1 



1-P2 

is the value of the function J lower for the model where the water costs have not been 



taken into account (see relation (|9.32p b So, the function 



slower 



given by (|10.21[) is 



a new element for the function j lower . 

Representations (|10.13|) and (|10.21|) are not convenient, and for the purpose of 
the further analysis we provide other representations. 
Introduce the following functions: 



(10.22) 



V>(C) = lim 



y-n-i .d_JG_\ 
^0 ( 



_2C 

Pi, 2" 
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(10.23) r?(C) = lim - 



Since c, is a bounded sequence, then the both limits of (|10.22|) and (|10.23[) do exist. 
Immediate algebraic calculations show that c upper = ip(C) and c lower — 77(C) if one 
substitutes the exact representation for the corresponding limits: 

hmIv7l-J^V = ^fl-e--/- 

j=0 x ' 

and 

Um I V f 1 + J^V = |* (e 2C /?- - 1 

The functions ip(C) and 77(C) satisfy the following properties. The function 
?/>(C) is a decreasing function, and its maximum is ip(0) = c*. The function 
77(C) is an increasing function, and its minimum is 77(0) = c*. Recall that c* = 
lim JWOO — °i- 

The proof of these properties is based on the following properties of numerical 
series (see Hardy, Littlewood and Polya [45] or Marschall and Olkin 56J). Let 
{«„} and {b n } be arbitrary sequences of numbers. If one of them is increasing but 
another is decreasing, then for any finite sum 

; 1 1 

(10.24) a » 6 « ^ 7 X! a " £ 5 «- 

n— 1 n— 1 n— 1 

If both of these sequences are increasing or decreasing, then 

/ ll 

(10.25) £ a " fo " - 7 X a ™ X 

7i—l n—1 n — 1 

Rewrite (|10.22l) and (|10.23|) as follows: 

2C V ,. ? J / 2C 



1 / 2C \ / 
(10.26) lim - V c„_ 7 1 - = ^(C) lim V 1 - 



n-+oo n •'—J \ Pi. 271 / n— >co ^— ^ y Pi, 271 



and 

n-l 



, 2C V / 

(10.27) lim - V c„_, 1 + = 77(C) lim V 1 



2C 

ra— >oo 71 ' i — J " y Pl.2 n J n— >oo \ Pi, 271 

Applying inequality (|10.24p to the left-hand side of (|10.26() and letting n — > 00, 
we obtain: 

lim - y c„_j (1 - — ] 

n_> °° 71 ~^ \ Pi, 271/ 

^ n—1 ^ n—1 * 

(10.28) < lim -y c „_j lim - y (l - 

3=1 

= ^(0) Hm 1 



ra— >oo 77, ^ — ' ri^oo 77, ^ — ' \ p l 2 7l 

3=1 3=1 x ' 

»=i / 2C x 3 



n— >oc 77, » — J y Pl,2 n 
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Comparing (|10.26p with ()10.28j) we arrive at 

^(0) = c* > V(C), 

i.e. ^(0) = c* is the maximum value of tp(C). 

To show that ip(C) is a decreasing function, we are actually to show that for any 
nonnegative C\ < C we have ip(C) < ip(Ci). The proof of this fact is based on the 
following asymptotic relation. For small positive 5± and S 2 we have 1 — 5% — 82 = 
(1 — 5\){1 — 62) + 0(^1^2)' In out terms, this means that for C\ < C we have: 

2C 2d \ f i 2C-2d \ / 1 



Pi,2« \ Pi,2 n / \ Pia n 

Therefore, similarly to (|10.28|1 for the left-hand side of (|10.26p we have0 

n-l 



lim - Y 



n-l 



n— 7 



2C 



lim — 

n— *oo 7i ^ — ' 



Cn-j I 1 



(10.29) 



2Ci V / 2C-2d 



" 1 ' 2 Ci Y ,• 1 ( 2C*-2C*i 



,. 1 2Ci V ,. 1 /\ 
< lim — > c„_, 1 — — hm — > 1 



n-l 



n^oo n. ^— ' \ /)i on / n— too n ^ — 4 \ 



n^oo rt 1 — ' \ pi <yn I n— >oc n * — ' \ pi on 

On the other hand, by using inequality (|10.25[) for the right-hand side of (|10.26[) 
we have: 



n-l , 

i>(C) lim - V 1 - 



2C 



n-l 



3 



10.30 = ^ C hm - V 1 - ^ 1 = i 

rl ^oo n ^ V Pi, 2™/ V Pl,2« / 

n-»oo n ^ \_ Pl,2"-/ «^°° n ~^ V Pi, 2" / 

Hence, the above monotonicity property follows from (|10.29p and (|10.30|) . Notice, 
that the inequality in (|10.30p is in fact the equality. 

Similarly, on the base of relation (|10.27| one can show the monotonicity of the 
other function n(C). 

All of these properties enables us to formulate the following general result. 

Theorem 10.8. The solution to the control problem is p\ = 1 if and only if the 
minimum of the both functionals J u PP er and J lower is achieved for C = 0. In this 
case, the minimum of objective function J is given by (|10.10p . Otherwise, there 
can be one of the following two cases for the solution to the control problem. 



^This is a very short version of the original proof given in |13| . If ci = c, i.e. all coefficients are 
equal to the same constant, then the inequality in (110.291 becomes the equality. For the following 
technical details associated with this property see |13| . 
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(1) If the minimum of J upper is achieved for C = 0, then the minimum of J lower 
must be achieved for some positive value C — C_. Then the solution to the control 
problem is achieved for pi = 1 — 5, 8 > 0, such that Sn — > C_ as n — > oo. 

(2) If the minimum of J lower is achieved for C — 0, then the minimum of J upper 
must be achieved for some positive value C — C. Then the solution to the control 
problem is achieved for pi = 1 + 6, 5 > 0, such that 5n —* C as n — > oo. 

The minimum of the functionals J u PP er and J lower can be found by their differ- 
entiating in C and then equating these derivatives to zero. 

From Theorem 110.81 we have the following property of the optimal control. 

Corollary 10.9. The solution to the control problem can be pi = 1 only in the 
case where 

(10.31) j x <j 2 ^2—, 

1-/02 

The equality in relation (|10.31[) is achieved only for Ci = c, i = 1, 2, . . . , n, where c 
is an any positive constant. 

Paper (T3] discusses the case where the costs C; have a linear structure, and 
provides numerical analysis of this case. Specifically, [13] finds numerically the 
relation between ji and ji , under which the optimal solution to the control problem 
is pi = 1. 

11. Optimal policies of using water in large dams: Future research 

problems 

In Sect. [9] and 1101 optimal policies of using water in large dams are studied. 
Both these models are the same queueing systems with specified dependence of a 
service on queue-length, and in both of them the input stream is Poisson. The 
only difference is in the criteria of minimization. The minimization criteria in the 
simple model is based on penalties for passage across the lower and higher level. 
The minimization criteria of the extended model takes also into account the water 
costs depending on the level of water in the dam. 

However, the assumption that input stream is Poisson is restrictive. So, the 
following extension of these models towards their clearer application in practice lies 
in an assumption of a wider class of input process than ordinary Poisson. In this 
section we discuss a possible way of analysis in the case when the input stream is 
a compound Poisson process. 

Let ti, t2, ■ ■ ■ be the moment of arrivals of units at the system, and let m, K2, ■ ■ ■ 
be independent and identically distributed integer random variables characterizing 
the corresponding lengths of these units. As in Sect. [7] it is reasonable to assume 
that 

P{ K lower < Kl < K "PP er } = 1 

(see rel. (fTTHO . 

Let us recall the meaning of parameter n in the dam models of Sect. l51and[TT)l 
That parameter n is defined in the following formulation of queueing system. Con- 
sider a single-server queueing system where the arrival flow of customers is Poisson 
with rate A and the service time of a customer depends upon queue-length as fol- 
lows. If, at the moment the customer's service beginning, the number of customers 
in the system is not greater than n, then the service time of this customer has 
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the probability distribution B\ (x) . Otherwise (if there are more than n customers 
in the system at the moment of the customer's service beginning), the probability 
distribution function of the service time of this customer is B2(x). 

In our case customers arrive by batches Ki, K2, ■ ■ ., so as in Sect. [Jjit is reasonable 
to define the random parameter £ = £(n): 

£ = sup 

There are two fixed values £ /oloer and £"PP er depending on n and 

p flower < K . < £«pperj = L 

Thus, the following construction, similar to the construction that used in Sect. 
holds in this case as well. Specifically, Definition 17. II and the following application of 
the formulae for the total expectation for characteristic of the system with random 
parameter £ are the same as above in Sect. [Jj Then the definition of random 
variables Tj* , Tj* , i/^ 1 , with random parameter £ is similar to the definition 
of the corresponding random variables Tn \ Tn \ v„ , Vn given in Sect. l9"land[TOl 

There are also equalities allying Ez/SL with Ez^^ and F,T^l\ with ET«\ as 



and 



ET%\ =bx „ET^\ 



The sequences ai, n , a,2.m i>i,n and &2,n converge to the corresponding limits a%, a.2, 
b\ and &2- But the values of constants a\, 02, 61 and 62 are not the same as those 
given by (|9.8p and (|9. 10[) . Special analysis based on renewal theory to find these 
constants is required. 

Another difference between the analysis of the problem described in Sect. [TO] and 
that analysis of the present problem is connected with the structures of water costs. 
In the case of the problem described in Sect. [TO] the water costs are non-increasing. 
In the present formulation, where the length of arrival units are random, the water 
costs, being initially non-increasing with respect to levels of water, after reduction 
to the model with random parameter £ become random variables. However, the 
expected values of these random costs satisfy the same property, they are non- 
increasing. 

So, the statement on existence and uniqueness of an optimal strategy of water 
consumption is anticipated to be the same as in the earlier consideration in Sect. 
1101 where, however, the optimal solution itself and its structure can be different. 

12. The buffer model with priorities 

In this section we give the application of Takacs' theorem for a specific buffer 
model with priorities. This section contains one of the results of [TO] related to the 
effective bandwidth problem [TO] , and the model studied here is a particular case of 
more general models of [TO] . The effective bandwidth problem was a "hot topic" of 
applications of queueing theory during the decade 1990-2000. The detailed review 
of the existence literature up to the publication time can be found in the paper of 
Berger and Whitt [2T]. For other papers published later than aforementioned one 
see [22], [23], [33J, [35], [H], [50], [53], [HI], M and other papers. 
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Let A(t) be a renewal process of ordinary arrivals to telecommunication system 
having a large buffer of capacity N. Each of these arrivals belongs to the priority 
class k with positive probability p^ k \ 2fc=iP^ = lj where a smaller index corre- 
sponds to a higher priority. By thinning the renewal process A(t) we thus have £ 
independent renewal processes A^'(t), A^ 2 '(t),. . . , A^'(t), where the highest pri- 
ority units are associated with the process A^(t), and arrivals corresponding to 
A^(t) have higher priority than arrivals corresponding to A^'it) for i < j. 

The departure process, T>(t), is assumed to be a Poisson process with constant 
integer jumps C > 1. The process T>(t) is common for all of units independently of 
their priorities. 

Let Q( fc ) (t) denote the buffer content in time t for units of priority k. All of the 
processes considered here are assumed to be right continuous, having left limits, 
and all of them are assumed to start at zero. Exceptions from these rules will be 
mentioned especially. 

Let us now describe the priority rule. To simplify the explanation, let us first 
assume that the buffer is infinite. Then, for the highest priority units we have: 

(12.1) Q (1) (t) = max{0, Q {1) {t-) + AA (1 \t) - AV{t)}, 

where the triangle in (|12.1ll denotes the value of jump of the process in point t, i.e. 
AA^(t) = A^(t) - A^(t-), AV(t) = V{t) - V(t-). 

For the second priority units, we have: 
(12.2) 

Q^(t) = max{0, Q^(t-) + AA^(t) - [AV{t) - Q (1) (H] l {G a)(t)=o}} • 
In general, for the k + 1st priority units (fc = 1, 2, . . . , I — 1) we have 
(12.3) Q {k+1) (t) = max{o,Q (fc+1) (H + A^ fe+1 )(<) 



k 

Ai>(t)-5^e«(t- 

i=l 

Equations (112. 2p and Q12.3P implies that the priority rule is the following. The 
units are ordered and then leave the system according to their priority as follows. 
Let, for example, there be 6 units in total, two of them are of highest priority and 
the rest four are of second priority. Let C — 3. Then, after the departure of a 
group of three units, there will remain only 3 units of the second priority. That is 
all of the units (i.e. two) of the highest priority and one unit of the second priority 
leave simultaneously. 

For k = 1, 2, . . . , £, using the notation 

Q fc W = Q (1) (i) + Q (2) + ... + Q w , 

and 

A k (t) = A (1) (t) + A {2) + ... + A [k) 
enables us to write the relations 

(12.4) Q k {t) = max{0, Q k (t-) + AA k (t) - AV(t)}, 

which arc similar to (|12.1j) . The equivalence of (|12.4ll and (|12.1ll - (|12.3|) is proved 
by induction in [15]. 



1 {E?=iSW(t)=o} 
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According to (|12.4|) . the stability condition for this priority queueing system 
with infinite queues is pi < 1, where pe — j^j, A is the expected number of ar- 
rivals per time unit, p the parameter of departure Poisson process, and C is the 
aforementioned constant jump of this Poisson process. We will assume that this 
condition holds for finite buffer models too (for finite buffer models the above sta- 
bility condition is not required). So, if all the buffers are large, then the losses occur 
seldom. 

In the case of finite buffer models, the representations are similar. Denote the 
capacity for the total number of units of priority k (the number of units of priority 
k that can be present simultaneously in the system) by N^ k \ and iV^ 1 ) + iV^ 2 ) + 
. . . + N™' = N. We will assume here that if upon an arrival of a batch, the buffer 
of the given class is overflowed, then the entire arrival batch is rejected and lost 
from the system. 

Introduce new arrival processes A (t), k = 1, 2, . . . , £, corresponding to the fcth 
priority as follows. Let the jump A .4 (t) is defined as 

(12.5) AA {k \t) = AA (k) (t)l {QlkHt) < N(k)} . 

The difference between the process A^(t) and A W (t) is only in jumps. In the 
case of the originally defined process A^ (t) the jumps are AA w (t), while in the 

case of the process A (t) they are AA (t). In addition, it turns out that the 

process A^ "" (t) is not right continuous. There are isolated points at moments of 
overflowing the buffer of the given priority units. 

Then the buffer content for units of the highest priority is defined by equations: 

(12.6) Q«(i) - max{Q^{t-) + AA {1) (t)-AV(t)}, 

(12.7) Q (1) (i+) = max{Q( 1 )(t-) + A^ (1) (t)- AV{t)}. 

In all continuity points of the processes QS k '(t), k — 1,2, one can obtain 

general representation similar to that of (|12.4|) . Denoting 

A k {t) =A (X) (t) + A {2) {t) + . . . + A (k \t), 
one can show the following representations: 

(12.8) Q k (t) = max{Q k (t-) + AA k (t)-AV(t)}, 

(12.9) Q k {t+) = max{ Qfc(t-) + AAk(t) - AT>(t)}, 

which are supposed to be correct for continuity points of the processes Qk (t) only. 

According to representations (|12.8[) and (|12.9[) , the cumulative buffer contents 
Qk{t), k — 1,2,. . .,£, in continuity points behave as usual queue- length processes 
in GI/M c /l/N k queueing systems, where N k = 7V(i) + N&) + ... + (N e = 
N). However, the behavior of the number of losses is essentially different. The 
losses in GI/M C /1/N k queues are not adequate to the losses in the corresponding 
cumulative buffers Q k (t). Specifically, the losses in GI/M C /1/N k queues occur only 
in the case when the buffer is overflowed upon arrival of a customer meeting all of 
the waiting places busy. The losses in the cumulative buffers Q k (t) can occur in 
many cases, when one of the buffers of priority units (say the jth buffer, 1 < j < k) 
is overflowed. 
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However, in some cases when the values N± < N2 < . ■ . < Ni all are large, the 
correspondence between GI/M C /1/JVjt queues and finite buffers models, giving us 
useful asymptotic result, is possible. Specifically, the loss probability of a customer 
arriving to one of the first k buffers is not greater than 7Ti + 7r2 + . . . + 7Tfc , where 7Tj 
denotes the loss probability in the corresponding GI /M /1/JVj queueing system. 

Let Ai{x) (i — 1,2,..., I) denote the probability distribution function of inter- 
arrival time between arrivals of one of the first i priority customers, Ai(s) is the 
Laplace-Stieltjes transform of Ai(x). All of the probabilities Hk are small and de- 
crease geometrically fast (see Theorem 112.11 below). Since the loads pi, p%,. . . ,pe 
of corresponding cumulative processes increase, i.e. pi < P2 < ■ ■ ■ < pe, then the 
roots (fik of the corresponding functional equations appearing in the aforementioned 
theorem are ordered (p% < if2 < • • • < <Pk' Such type of dependence between the 
roots ifk and the loads pk, k = 1, 2, . . . , I is because of the special construction of 
interarrival times. Then, under the assumption that tp^ 3 — o(<p^ k ), j < k, (i.e. the 
losses of lower priority customers occur much often compared to those of higher pri- 
ority) the loss probability of the cumulated buffer of the first k priority customers 
can be approximated by iik- In this case we have the following theorem. 

Theorem 12.1. For the loss probability 7Tfc of cumulated buffer content we have 
the following estimation: 

(12.10) 

(l-p k )[l + CpA> k (p-ptf)]^ 



(1 - Pk ){l + tp k + <p 2 2 + . . . + (p° r )- p k [l + CpA' k (p - )]^ fc 
+0 {<$«•), 



whe 



Pk 



pC 

k 



and ifk is the least positive root of the functional equation 

z = A k (p - pz c ) 

in the interval (0,1). 

Proof. We consider the GI /M c /1/Nk queueing system and, similarly to the proof 
of Sect. [H this proof is based on an application of Takacs' theorem. Following 
Miyazawa [5S], the loss probability for the GI/M Y /1/Nk queueing system (in this 
notation the batch size Y is an integer random variable rather than a determinis- 
tic constant that in the cases of the notation GI /M c /1/Nk considered before) is 
determined by the formula 

(12.11) = ~, 

which is similar to relation (|4.1[) . The generating function of rfcj is 

(12.12) R k {z) = ^ r K] z J = »r- — — , 

^ A k [p- pY{z)]- z 
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where Y(z) is the generating function of a complete batch size. In the case of 
GI/M C /1/Nk queueing system Y(z) = z c , and (112.1211 is rewritten 

/ x (1 - z c )A k (u - UZ C ) 

(12.13) R k (z) = ^ '— ^- — " — '-. 

A k (n - [iz c ) - z 

Expanding (l~z c ) in the numerator of (|12.13|) as l-z c = (l—z)(l+z+. . .+z c ~ 1 ), 
we have: 

(12.14) Rkiz)= (l-zKl + z + f + ... + z^)M,-,zC)^ 

A k (fj, - fiz c ) - z 

Now, let us consider the other generating function given by Rk{z) = j^R(z). 
From (|12.14p we obtain: 

(12.15) R k (z) = f>,^ = (1 + ^^+ ; -- + ^- 1 Wm-^) > 
and the loss probability is 

(12.16) 7T k = =J— . 

r k,N k 

Now, application of Takacs' theorem is straightforward, because the term 

A k (p - [iz c ) 
Akiji - ptz c ) - z 

of (|12.15p has the representation similar to (|1.3p , and therefore the corresponding 
coefficients of the generating function satisfy recurrence relation (|1.2[) . 
For large N k we obtain: 

(12 ' 17) ^ ~ l + ,CA(,-^ k) 

Pk - 1 

Asymptotic relation (|12.10[) follows from (|12.16|) and (|12.17[) . □ 
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